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METHOD AND APPARATUS FOR IMPROVING DECOMPRESSION AND COLOR 
SPACE CONVERSION SPEED 

CROSS REFERENCE TO RELATED APPLICATIONS 
[0001] The present application claims the benefit of United States Provisional 
application number 60/299,260 (attorney's docket number 10006809-1), filed 
on August 30, 2000, the entire disclosure of which is incorporated by reference 
herein. 

FIELD OF THE INVENTION 
[0002] This invention relates to decompression and color space conversion in a 
data pipeline. More particularly, this invention relates to a method and 
apparatus for improving the speed of decompression and color space conversion 
in a data pipeline. 

BACKGROUND OF THE INVENTION 
[0003] The Winograd algorithm is an efficient way to compute an inverse 
discrete cosine transform (DCT) used in decompression of data compressed in a 
JPEG compression process. However, the format generated by the algorithm is 
a non-standard format. Converting this non-standard format to a format that is 
usable in a data pipeline for subsequent operations performed in the pipeline 
requires computations that significantly decrease the overall speed at which a 
decompression operation can be performed. If an efficient way could be found 
to convert the format generated through the operation of the Winograd 
algorithm, an improvement in the decompression speed could be realized. 



DESCRIPTION OF THE DRAWINGS 
[0004] A more thorough understanding of embodiments of the conversion 
apparatus may be had from the consideration of the following detailed 
description taken in conjunction with the accompanying drawings in which: 
Shown in Figure 1 is simplified block diagram of an embodiment of conversion 
apparatus. 

Shown in Figures 2A and 2B are representations of the output from the 
Winograd algorithm 

Shown in Figure 3 is pseudo code representing the operation of normalization 
and clipping block 14. 
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Shown in Figures 4A through 4D are register definitions for the hardware 
portion of an embodiment of the conversion apparatus. 
Shown in Figure 5 are programming and configuration protocols for an 
embodiment of the conversion apparatus. 

DETAILED DESCRIPTION OF THE DRAWINGS 
[0005] Although an embodiment of the conversion apparatus will be discussed 
in the context of the decompression of color image data and the conversion 
between color spaces, it should be recognized that the disclosed principles may 
be usefully applied in other contexts in which a rapid computation of an inverse 
DOT with an output in a standard format is needed. 

[0006] Shown in Figure 1 is a high level block diagram of an embodiment of 
the conversion apparatus 10. Block 12 represents the computation of the 
inverse OCT using the Winograd algorithm. In this embodiment of the 
conversion apparatus the output generated from the computations performed in 
block 1 2 is in the YCaCb color space. The input to block 1 2 is JPEG 
compressed YCaCb color space data. The Ca and Cb color space components 
may have been sub-sampled to reduce the amount of data. The human eye is 
less sensitive to the chrominance and hue components of the color space than 
the luminance component of the color space. The sub-sampling may be done, 
for example, by discarding the Ca and Cb data 3 out of every 4 pixels. It should 
be recognized that other sub-sampling schemes would be compatible with 
embodiments of the conversion apparatus or, no sub-sampling may be 
performed. 

[0007] The Winograd algorithm is well suited to efficient computation of an 
inverse DCT. It is computationally efficient and relatively easily coded in 
assembly language. However, one drawback of its computation of the inverse 
DCT is that it provides the data in a non-standard format. Shown in Figure 2A 
is the output format generated from block 12 for one component of the color 
space. The format of the output is the same for each component of the output 
YCaCb color space. Bit 100 is a sign bit. Bits 102 are 2 overflow bits. Bits 
104 are 8 bits corresponding to an integer value between 128 to -127. Bits 
106 are 5 bits corresponding to a fractional value. This format is converted for 
the performance of the color space conversion. Shown in Figure 28 is a 
generalized representation of the assignment of the bits. It is possible for 
embodiments of the conversion apparatus to have varying number of in the 
output generated by block 12. In Figure 28, "p" represents the number of bits 
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used to represent the fractional portion of the value generated by block 1 2. 
[0008] Normalization and clipping block 14 represents the normalization 
process that converts the 1 6 bit values for each component of the color space 
and for each pixel into an 8 bit value ranging from 0 to 255. The normalization 
performed in normalization and clipping block 14 includes converting the 128 to 
-127 values to a corresponding value from 0 to 255. If the integer portion of 
the output generated by block 12 is already in the range from 0 to 255, the 
normalization is not performed. Shown in Figure 3 is pseudo code representing 
the hardware operations performed by normalization and clipping block 14. The 
pseudo code shown in Figure 3 represents the operations performed by the 
hardware in normalization and clipping block 14 to convert the 16 bit output 
generated by block 1 2 into a format that can be used in the color space 
conversion block 16. 

[0009] Color space conversion block 1 6 performs a color space conversion by 
performing a matrix multiplication and adding an offset value. A 3 by 3 
conversion matrix is used to convert the YCaCb color space data provided from 
normalization and clipping block 14 into components of the color space output 
from color space conversion block 16. In one embodiment of the conversion 
apparatus, the output color space generated from color space conversion block 
16 is an RGB color space. It should be recognized that conversion to other color 
spaces could be performed. For example, in some applications it would be 
useful to have color space conversion block 16 convert from a YCaCb color 
space to a CMY color space. Provide below in equations 1-3 are the operations 
performed in color space conversion block 16. The operations performed to 
generate each component of the output color space include a matrix 
multiplication, addition of an offset, and a shift to create an 8 bit result. 

Eq. 1 R = (Sr -i-Y*M11 + Ca*M12 + Cb*M13) > >(5 4- Shift Precision) 
Eq. 2 G = (Sg -»-Y*M21 + Ca*M22 -I- Cb*M23) >>{5 -t-Shift Precision) 
Eq. 3 B = (Sb +Y*M31 + Ca*M32 + Cb*M33) > >(5 -I- Shift Precision) 

In this equations, Sr, Sg, and Sb are offsets added in color space conversion 
block 16. Mil through M33 are the elements of the 3 by 3 matrix (the M 
array). 

[0010] The output of the color space conversion block 1 6 is two words. One 
word includes the 8 bit R component and 8 bits of Os. This word is provided to 
the firmware as OR. The other word includes the 8 bit G component and the 8 
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bit B component. This word is provided to the firmware as GB. In the case of 
an underflow in the process, the hardware generates a 0 for the corresponding 
component, in the case of an overflow in the process, the hardware generates 
a 255 for the corresponding component. 

[001 1] The 3 by 3 array used in the matrix multiplication is generally written 
into color space conversion block 16 once during setup. All the values in the M 
array are 9 bits. The 9 bits include 8 bits of magnitude and 1 sign bit. All the 
values are in .8 format. That is, they represent values less than 1 . For 
computation purposes they can be treated as 8 bit values. The Sr, Sg, and Sb 
values are all written as 16 bit values and a separate sign bit. These values are 
generally written once during setup. 

[0012] The Y value provided to color space conversion block 16 is updated for 
every pixel. However, because of the possibility of sub-sampling, the Ca and Cb 
values may not be updated every pixel. For 4:1 :1 sub-sampling, the same Ca 
and Cb values are used for 4 Y values. The hardware in normalization and 
clipping block 14 and in color space conversion block 16 is designed to compute 
the R, G, B values in minimum time for each pixel whether each of the Y, Ca, 
and Cb values have been written, or whether only the Y value has changed for 
the pixel. The Y values is updated last. The updating of the Y value is used to 
trigger the operation of normalization and clipping block 14 and color space 
conversion block 16. If the Ca and Cb values have not been updated, the 
hardware in normalization and clipping block 14 and block 16 uses the previous 
values to minimize processing time. All of the matrix computation performed in 
color space conversion block 16 is done with 18 bit precision so that overflows 
are kept. If an overflow occurs, the output for that component of the color 
space is clamped to 8'hFF. 

[0013] The hardware in normalization and clipping block 14 and color space 
conversion block 1 6 uses a data acknowledge handshake to insure that the 
processing is complete before the data can be read and to insure that the 
current results are read before new data can be written. Therefore, it is possible 
for the CPU to create a lockout condition. To address this, the hardware 
includes a 16 clock cycle timeout to prevent the lockout condition from lasting. 
A status bit is set if this occurs. 

[0014] Shown in Figures 4A through 4D are register definitions for the 
hardware in normalization and clipping block 14 and color space conversion 
block 1 6. Shown in Figure 5 are programming and configuration protocols for 
an embodiment of the conversion apparatus. 
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